NILPOTENT ORBITS OF LINEAR AND CYCLIC 
QUIVERS AND KAZHDAN-LUSZTIG POYNOMIALS 

OF TYPE A 

ANTHONY HENDERSON 

Abstract. The intersection cohomologies of closures of nilpotent 
orbits of linear (respectively, cyclic) quivers are known to be de- 
scribed by Kazhdan-Lusztig polynomials for the symmetric group 
(respectively, the affine symmetric group). We explain how to sim- 
plify this description using a combinatorial cancellation procedure, 
and derive some consequences for representation theory. 
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1. Introduction 

This paper is concerned with formulas for the intersection cohomolo- 
gies of closures of nilpotent orbits of linear and cyclic quivers. By fun- 
damental results in geometric representation theory, these intersection 
cohomologies control certain features of the representations of affine 
Hecke algebras and quantum affine algebras. There is a well-known 
formula in the linear case due to Zelevinsky, using Kazhdan-Lusztig 
polynomials of the symmetric group; there is an analogous formula 
in the cyclic case due to Lusztig, using Kazhdan-Lusztig polynomials 
of the affine symmetric group. The main point of this paper is that 
both formulas can be rewritten in terms of Kazhdan-Lusztig polyno- 
mials for different (potentially smaller) symmetric or affine symmetric 
groups, by applying a combinatorial 'cancellation' procedure due to 
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Billey and Warrington. The rewritten formulas in the linear quiver 
case have already appeared, in a representation-theoretic guise, in the 
work of Suzuki and others; in the cyclic quiver case they are new. 

In the remainder of the introduction we will survey the main re- 
sults and their representation-theoretic consequences; the other sec- 
tions give the proofs, concentrating on the combinatorial side of the 
story. Sections 2 and 4 are purely combinatorial, explaining the con- 
cept of 'cancellation' for the symmetric group and affine symmetric 
group respectively. Most (perhaps all) of the results in Section 2 are 
known, but we will go over them in detail to provide a reference for the 
generalizations to the affine case in Section 4. Sections 3 and 5 connect 
these combinatorial results to the problem of computing intersection 
cohomology. 

Throughout the paper, all vector spaces, algebras and varieties are 
over C. 

Consider the linear quiver of type A^, with vertex set Z and arrows 
% — > % + 1 for all i £ Z. Finite-dimensional representations of this 
quiver are parametrized by multisegments: a segment is a nonempty 
finite interval in Z, and a multisegment is a finite formal sum 
of segments. Now fix a Z-graded finite-dimensional vector space V = 
ieZ Vi. Let di = dimVi, d = dimV. A representation of the quiver 
on V is simply an element of 

My = {ip e End(V) | ip{Vi) C V i+1 , Vi G Z}. 

Two such representations are isomorphic if they are in the same orbit 
for Gy — {g e GL(V) \g(Vi) = Vi,Wi}, acting on My by conjugation. 
Since all elements of My are nilpotent as endomorphisms of V, we call 
these nilpotent orbits. They are clearly in bijection with M^), the set 
of multisegments such that each % occurs di times as an element of a 
segment. For m e Mu.\, let O m denote the corresponding orbit in My. 
We put a partial order ^ on M( d .) by setting m ^ m' if and only if O m 
is contained in the closure O m > of O m '. 

The extent to which O m ' is singular at the points of O m is measured 
by an intersection cohomology polynomial IC m m i G N[q], defined by 

ic m , m/ = ]Tdim^/c(er;)g\ 

i 

where IC{O m >) is the intersection cohomology complex of O m /, and 
denotes the stalk at a point of O m of the (2i)th cohomology sheaf (it 
turns out that all odd-degree cohomology sheaves of IC(O m >) vanish). 
Note that /C m ,m' is nonzero if and only if m ■< m', and is 1 if m = m'. 
Hence the inverse matrix (/C^,)m,m'eM (di) of (JC m , m ')m,m'eM (di) has 
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entries in Z[g]; moreover IC^J^, is zero unless m ^ m', and is 1 if 
m = m'. 

From the viewpoint of geometric representation theory, the poset 
M(^.), together with these IC polynomials, is a model for certain "blocks" 
of representations of Lie-theoretic algebras of type A. More concretely, 
the algebras listed below each have a collection of finite-dimensional 
standard modules {M m | m G M^)} and a collection of finite-dimensional 
simple modules {L m | m G Mr^}, which are related by the following 
(equivalent) equations in the Grothendieck group of modules: 

/C, m,m'(l) [L m ,], Vm G M (dih 
E /C, im'(l) [Mm'}, Vm G M {di) . 

m'eM {di) 

So the sum of the coefficients of /C m m / is a composition multiplicity of 
a standard module; the individual coefficients record the composition 
multiplicities in a certain Jantzen-like filtration. For each algebra, the 
general definition of standard modules allows segments of arbitrary 
complex numbers, not just integers; but the problem of computing 
composition multiplicities can be reduced to the integer case. The 
algebras in question, and references to the definitions and results, are 
as follows. 

(1) The affine Hecke algebra Ji d attached to GL d , specialized at 
a parameter which is not a root of unity (as in [5, Defini- 
tion 12.3.1]). The standard and simple modules were defined 
by Zelevinksy in [21], and (jl.lj) was conjectured in [25] (see 
also [19]). Ginzburg proved (11.11) for standard modules defined 
in a geometric way (see [HJ Theorem 8.6.23]). The fact that 
Ginzburg's standard modules coincide with Zelevinsky's in the 
Grothendieck group is usually deduced from the Induction The- 
orem of Kazhdan and Lusztig (see [2J - nowadays the best ver- 
sion of the Induction Theorem to use is f5J Theorem 7.11]), 
though it should be regarded as a comparatively easy case of 
that result. 

(2) The corresponding degenerate affine Hecke algebra (as in [5, 
Definition 12.3.2]). The definitions of standard modules (as in 
[2U Section 2.2]) are analogous to case (1), and indeed (jl.ljl in 
this case can be deduced from case (1) by the results of Lusztig 
in [TT] - he also gave a proof specific to this case in [T3] . 
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(3) The quantum affine algebra U e (sl r ), specialized at a parame- 
ter e which is not a root of unity (as in [HI Section 12.2A]). 
Here the standard modules are tensor products of fundamental 
evaluation modules corresponding to the segments, so we need 
r to be greater than or equal to the length of the longest seg- 
ment involved (otherwise, we could just stipulate that any mod- 
ule indexed by a multisegment containing a segment of length 
> r is zero). Equation can be deduced from case (1) 
by Frobenius-Schur duality (see Section 12. 3D]). Alterna- 
tively, with a geometric definition of standard modules, (jl.lj) 
was proved by Ginzburg and Vasserot (see (221 Theorem 3]). 
It then follows that the two kinds of standard modules are 
the same in the Grothendieck group (see [2H1 Proposition 18]), 
which can presumably also be proved directly. 

(4) The Yangian Y(sl r ) (as in Section 12. 1A]). The standard 
modules as defined by Drinfeld in [7] are analogous to those in 
case (3), and (|1.1|) in this case can be deduced either from case 
(3) or case (2) using the results in jjj. 

This profusion of representation-theoretic meanings of the polynomials 
^C m ,m' and IC^ ^, is the main reason to be interested in computing 
them; but it is also why, in this paper, the clear-cut geometric definition 
is given greater prominence. 

A classic result of Zelevinsky (j2HJ Corollary 1], see Theorem 13.21 
below) identifies the polynomials /C mm ' with Kazhdan-Lusztig poly- 
nomials of the symmetric group Sd- More precisely, it provides an iso- 
morphism of posets between M^) and a lower ideal of the poset 
of maximal-length representatives of S^-S^) double cosets (under 
Bruhat order), where S^) is the parabolic (i.e. Young) subgroup of 
Sd determined by the composition d = J2i di', and the polynomials at- 
tached to these posets (IC polynomials for M^), and Kazhdan-Lusztig 
polynomials for MLs) coincide under this isomorphism. Zelevinsky's 
proof is geometric, embedding the nilpotent orbits O m as open subvari- 
eties of certain Schubert varieties, and using the fact that the intersec- 
tion cohomologies of the latter are described by Kazhdan-Lusztig poly- 
nomials; but the point is that the poset ML and its Kazhdan-Lusztig 
polynomials can be defined (and, in principle, computed) purely com- 
binatorially. 

More recent work of Suzuki ([21]) implicitly generalizes this result, 
providing a family of poset isomorphisms between various upper ideals 
of Mfc) and combinatorially-defined posets. To explain this we adopt 
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the notation of ^Zj, which views multisegments as "generalized skew- 
shapes". For A,jU G Z k , write A 3 /x if \ > fa for all 1 < i < k, and if 
this holds define a multisegment 

k 

(1.2) A/// = ^[//i-i + l,Ai-z], 

where any "empty segments" of the form [s + l,s] are ignored. The 
reason for the notation is that if A and /i are partitions, i.e. Ai > 
■ • ■ > Afe > and similarly for fa then the segments are exactly the 
rows of the skew-shape diagram usually called X/ fa where each box is 
replaced by its content. Since the order of terms in (J1.2)) is unimportant, 
A//i = (w ■ X)/(w ■ fa) for all w £ Sk, where the "dot action" of Sk on 
Z fc is defined as usual by 

(1.3) (w ■ X)i - i = X w -i(i) - w~ l (i). 
A fundamental domain for this dot action is 

D k := {X £ Z k | Ai - 1 > A 2 - 2 > • ■ • > X k - k}, 
so we can write any multisegment in the standard form 

(1 4) XI (w ■ ) where I ^' ^ G Dk ' w e Sk > ^ - w ' /i ' and 
^ ' ' / \ t 1 ) | w ^g^g ma ximal length in W\wW^. 

Here H^x and are the stabilizers of A and fi for the dot action, 
which are clearly parabolic subgroups of S k - Note that this expression 
in standard form is not uniquely determined by the multisegment, but 
rather by the multisegment together with a chosen multiset of empty 
segments. 

Example. Let m be the multisegment [1, 2] + [2, 2] + [3, 3]. The most 
economical way to express this in the form (jl.4|) is to take k = 3, 
A = (4, 4, 5), /i = (3, 3, 3), and w to be the transposition (2, 3). Another 
way is to take k = 4, A = (4, 4, 5, 5), /x = (3,3,4,4), and w to be the 
transposition (2,4); this effectively adds the empty segment [2, 1]. 

If A, [A £ D k , we define 

S k [X, /i] = {w £ S k | A D w ■ fa} and 

S k [X,fi]° = {w £ S k [X,fi] | w has maximal length in W\wW^\. 

These are posets under Bruhat order; in fact we will see that S k [X,fi] 
is a lower ideal of S k , so in particular S k [X, /i] ^ <^ A D fa With this 
notation, the generalized form of Zelevinsky's result can be stated as 
follows. 



Theorem 1.1. Let X, fi £ D k be such that X 3 fa X/fJ, £ M ( 



(*)■ 



6 



ANTHONY HENDERSON 



(1) The map w i— > A/ (w • /i) is an isomorphism of po sets between 
S k [X,fi]° and {m' G M (di) \\/fi^ m'}. 

(2) For w,w' G S^/i] , ICa/^.a/k-aO = P w , w >, a Kazhdan- 
Lusztig polynomial of S k ■ 

Zelevinsky's original result is the special case where k — d, A is such 
that each integer % occurs cfj times in (Ai — 1, • • • , X& — d), and /i = 
A — (1, 1, • • • ,1). In this case A//i is the trivial multisegment ^ c?^[z, z] 
(corresponding to the zero orbit), so the image of the isomorphism in 
part (1) is all of Mr d .y, the parabolic subgroups W\ and both equal 
S(di), an d ^[A,/^] is the poset M^s mentioned above. 

The fact that Theorem II .11 is true in general means that in express- 
ing m and m' as X/{w ■ fi) and X/{w' ■ fi), any of the empty segments 
which occur in the Zelevinsky case can be "cancelled" without changing 
the Kazhdan-Lusztig polynomial (or, indeed, new ones can be added). 
For example, at the extreme, Theorem 11.11 shows that IC m m > can be 
identified with a Kazhdan-Lusztig polynomial of SW m ), where k(m) is 
the number of segments of m (smaller than d, unless m is trivial). In 
Section 3 we will use a result of Billey and Warrington, which pro- 
vides for just such cancellations in Kazhdan-Lusztig polynomials of 
symmetric groups, to deduce Theorem II. II from Zelevinsky's theorem. 
The essence of the result is stated in Theorem 13 .3[ using some matrix 
notation which will be introduced in §2. 

As already mentioned, Theorem II . II cannot be considered new, since 
in the context of the representation theory of the degenerate afline 
Hecke algebra (case (2) above) it follows from Suzuki's results in [2*T] . 
With notation as in the Theorem, he defines an exact functor Fx 
from the category O of representations of gl k to the category of finite- 
dimensional modules for the degenerate afline Hecke algebra associated 
to GLd, and shows that it takes the Verma module M(w ■ fi) to the 
standard module Mw^j and the simple module L(w ■ fi) to the sim- 
ple module Lx/fw-n) f° r ah w £ Sfc[A, /i] . Part (1) and the q = 1 
specialization of part (2) of Theorem 11.11 then follow from the known 
Kazhdan-Lusztig conjecture for gl k (combine [2U (5.2.1) and (5.2.2)] 
- the historical remarks following [2H (5.2.3)] properly apply only to 
the Zelevinsky case). Moreover, by j2B Theorem 5.3.5] the Kazhdan- 
Lusztig polynomials P w>w i for w' G Sfc[A,yu]° record multiplicities in 
a Jantzen-type filtration of Mx/( w -ti), whose definition clearly depends 
only on the multisegment (i.e. not on the empty segments); since (2) of 
Theorem 11.11 is true in the Zelevinsky case, it must be true in general. 
(As well as , see [T7j and pQ for the analogous results in the case of 
the afline Hecke algebra and Yangian respectively). 
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One corollary concerns those multisegments A//J where A,/i G Dk 
satisfy W x = = {1}, i.e. Ai > A 2 > • • • > A fc , /xi > /i 2 > ■ ■ ■ > fa 
(these are the "placed skew-shapes" of [H]) : for such A///, it follows 
from Theorem II. II that 

(1.5) IC x/%\/{v>-p) = £ H' for a11 w G ^f A ' tA> 

where e denotes the sign character. Thus the corresponding simple 
modules (called calibrated for the affine Hecke algebra in [TH] and tame 
for the Yangian in can be written as an alternating sum of stan- 
dard modules in the Grothendieck group. Representation-theoretically, 
this reflects the existence of a BGG-like resolution of these simple mod- 
ules (transferred by the appropriate functor from the BGG resolution 
of the 0[ fc -module L(/i)) - see [2D Theorem 5.1.1] and [13 (4.13)]. 

The justification for re-proving Theorem II .11 in §3 below is that the 
combinatorics involved generalizes immediately to the case of cyclic 
quivers, as we will now explain. 

Fix a positive integer n, and consider the cyclic quiver of type A n _i, 
with vertex set Z/nZ and arrows % — > i + 1 for all % G Z/nZ. Finite- 
dimensional nilpotent representations of this quiver are parametrized 
by multisegments as before, except that there is no difference between 
segments and when %' — i — j' — j is a multiple of n. Fix 

a (Z/nZ)-graded finite-dimensional vector space V = ©j gZ / nZ Vf, and 
set di = dim Vj, d = dim V. We define 

N v = {<pe End(V) | (p(V$ C V m , Vi G Z/nZ, <p nilpotent}, 

and consider Gy-orbits in J\fy- These are in bijection with M( d .) n , the 
set of multisegments (in this modulo n sense) such that each congruence 
class % occurs di times among the elements of the segments. For m £ 
M(di),n, let O m denote the corresponding nilpotent orbit, and define a 
partial order ^ and polynomials IC m m > G N[q] and IC^ 1 ^, G Z[g] in 
the same way as before. 

These polynomials too have representation-theoretic significance. The 
specialized quantum affine algebra U^(sl r ), where ( 2 is a primitive nth 
root of 1, has a collection of standard modules {M m | m G M( d .) n } 
and a collection of simple modules {L m \ m G Mua n }, satisfying the 
equivalent equations 

/C, m,m'(l) [L m '], Vm G M [di)>n , 

m'6Af (d . )in 



;i.6) 
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(See [2B1 Theorem 3] - again, for small r we have to disregard multi- 
segments containing a segment of length > r.) The same is true for 
the affine Hecke algebra Tid specialized at a primitive nth root of unity, 
except that there the simple modules are parametrized by the smaller 
set of aperiodic multisegments (see [TOJ Section 2]), so we have to set 
[L m ] = if m is not aperiodic. 

The analogue of Zelevinsky's result for cyclic quivers was proved by 
Lusztig in ^21 §11] (it is stated below as Theorem 15.2)1 . This identifies 
-fCm,m' with a Kazhdan-Lusztig polynomial of the affine symmetric 

group Sd (the Coxeter group of type Ad-i). In Section 4, we will 
show that a version of Billey and Warrington's cancellation works for 
the affine symmetric group. As a consequence, we get an analogue of 
Theorem 11.11 in this setting, for which a representation-theoretic proof 
does not yet exist. 

To state it requires extending the dot action of Sk on Z fc to S/., so 
that the extra Coxeter generator s ac ts by 

{\ k — k + 1 + n, if i = 1, 
Xi, if 2 < % < k - 1, 

Ai — 1 + k — n, if i = k. 

It is then clear that (w ■ A) / (w ■ /i) = A//i for all w G Sk, where the mul- 
tisegments are now interpreted in the modulo n sense. A fundamental 
domain for the action of Sk on Z fc is 

Dk := {A G Z fc | Ai - 1 > A 2 - 2 > ■ • • > A fc - k > Ai - n - 1}, 

and the corresponding standard form for multisegments is 

/-, ry\ x // \ i ] A, u G D k , w G Sk, A 3 w ■ u, and 
(1.7) \/{w ■ fx) where < ' r ' *> - _r> 

I w has maximal length in WxwW^, 

where Wa and denote the stabilizers of A and fi in Sk (proper 
parabolic subgroups, hence finite). For X, fi G D k , we define 

Sk[\ fj] = {w G Sk | A ~D w • ji} and 

Sk[\, fj]° = {w G (Sjfe[A, /x] | w has maximal length in W\wW^}. 

We will see in §5 that, as in the symmetric group case, Sk[\, fj] is 
a (finite) lower ideal of Sk for Bruhat order. We can now state a 
generalization of Lusztig's result. 

Theorem 1.2. Let \, jj, E D k be such that A D \i, A//x G M(^) i7l . 



NILPOTENT ORBITS AND KAZHDAN-LUSZTIG POLYNOMIALS 



9 



(1) The map whA/(w^) is an isomorphism of po sets between 
S k [\,fi]° and {W G M( di)jn | Xj \i < m'}. 

(2) For w,w' G S k [X,fj]°^ICx/( w ^),x/(w'^) = P w ,w', a Kazhdan- 
Lusztig polynomial of Sk ■ 

(An alternative statement using matrix notation is given in Theorem 
15.31 ) It is natural to wonder whether there is a representation-theoretic 
functor which "explains" this Theorem too. 

As in the linear quiver case, Theorem II .21 implies that IC m ^ m i can be 

identified with a Kazhdan-Lusztig polynomial of Sfc( m ), where k(m) is 
the number of segments of m; this immediately implies the main result 
of jH], that /C m ,m' = 1 when m ^ m', k(m) = 2. 

Another consequence of Theorem ll.2l is an analogue of (jl.5j) . concern- 
ing those multisegments A/u where A, u G Dk satisfy W\ = = {1}; 
this means that Xi > X 2 > ■ ■ • A& > Ai — n + k, ui > fi 2 > ■ ■ ■ > t^k > 
ui — n + k. For such A/«, it follows from Theorem II .21 that 

(1.8) = e («0> for a11 w e A*]- 

So once more the corresponding simple modules can be written as an 
alternating sum of standard modules in the Grothendieck group; prob- 
ably this indicates a BGG-like resolution. 

Theorems 11.11 and 11.21 combine well with the method used by Varag- 
nolo and Vasserot in [22] to determine the decomposition numbers of 
U^(gl r ) where ( 2 is a primitive nth root of 1. Suppose we want to com- 
pute the multiplicity of the simple module L^(fi') in the Weyl module 
V^(A'), where A and u are partitions with at most k parts all of size < r, 
and A' and «' are the transpose partitions (regarded as dominant inte- 
gral weights for $j[ r ). By definition, V^(A') is the specialization at ( of 
the simple module V^(A') for the generic U q (gl r ). Now using a suitable 
normalization of the evaluation map U q {s[ T ) — > U q (Ql r ), we can regard 

V^(A') as the simple U q (s t r ) -module L x /o (see [221 Section 12.2]). By 
(jl.5j) . we have the equation 

(1-9) [L x/0 ]= Yl 4w)[M x/{w . 0) ]. 

w£S k {\,0] 

Now let wxjW^jWq G Sk be such that w\ ■ A, ■ u, w ■ G D k . As 
noted in [221 Section 12.3], the specialization at ( of the standard mod- 
ule M A /(^. ) is merely the [/^(5[, r )-standard module of the same name, 
which in standard form is M {wx . x)/{wxWW -i )o . {wq . 0) , where (wxwWq 1 ) is 

the longest element of W Wx .\W\WWq 1 W W0 .q. So in the Grothendieck 
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group of U^isir) -modules, 

(1.10) [V C (A')] = J2 e H[ M («vA)/(«W)°-(«o-o)]- 

w£S k [\,0] 

Now as noted in [221 Section 12.2], L^(fi') regarded as a simple U^(sl r )- 
module is L m/0 = L {w ^ )/{WiiW -i )a<WQ , 0) , where (w^Wq 1 ) is the longest 

element of W Wfl . lJ w ^w^W^.q. Using Theorem 11.21 we obtain 

(1.11) _ 

[V^(A') : LrU')} = I ^«65* ^KttttpV.Kwo- 1 )^ 1 ^ if // G • A, 

i 0, otherwise. 

In the first case, summing over all of Sk rather than just S&[A, 0] in- 
troduces no new terms, since (w^Wq 1 ) E Sk[w^ ■ fx,wo ■ 0] = Sk[w\ ■ 
A, u>o-0], so the Kazhdan-Lusztig polynomial can only be nonzero when 
wxwwq 1 E Sk[w\ • A, wo • 0], i.e. 

In the special case that A and /i have trivial stabilizers in Sk (i.e. 
Ai — 1, • • • , Afe — k have different residues modulo n, and similarly for 
H - this requires k < n, which automatically implies w = 1), (jl.llj) 
becomes 

(1 12) WAX') ■ LAu!)\ = I £)«>es* £ ( w ) p w x w,w^l), if ii e S h • A, 
v \ 0, otherwise. 

This is the form of the answer given by Soergel in [23 Conjecture 7.1] 
for the equivalent problem of computing tilting module multiplicities 

forf/ ? ( y. 
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2. Cancellation for the symmetric group 

In this section we explain the combinatorial result of Billey and 
Warrington on which our approach depends. Fix a positive integer 
d, and let Sd be the group of permutations of [1, d] = {1, • • • ,d}. For 
i E [1, d — 1], we define Sj E Sd to be the transposition interchanging i 
and i + as everyone knows, si, • • • , Sd-i form a set of Coxeter gener- 
ators for Sd of type Ad-i- We thus have a length function I : Sd — > N, 
a Bruhat order <, and Kazhdan-Lusztig polynomials P y>w E N[q\ for 
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y,w G Sd (which are nonzero iSy < w). Good references for Kazhdan- 
Lusztig polynomials are [9., Chapter 7] and j20] (where the notation is 
somewhat different). 

The length function and the Bruhat order have well-known combi- 
natorial descriptions. Define the inversion statistics 

invj(u>) = \{i' < i \ w{i') > w(i)}\, InVj(w) = \{i' > i \ w{i') < w{i)}\, 

for any w G Sd and i G [l,d]. These are related by InVj(w) = mvj(w) + 
w(i) — i. Then 

(2.1) £{w) = invi(w) = Y Inv *M- 

ie[l,d] ie[l,d] 

A special case of Bruhat order is that for alH G [1, d — 1], 

(2.2) wsi < w if and only if w{i) > w{i + 1). 
The general description, due to Deodhar, is as follows: 
Proposition 2.1. Ify,w G Sd, y <w if and only if for alli,j G [l,d], 

\{i'<i\y(i') >j}\ < <i\w(i')>j}\. 

In other words, for all i G [1, d] and m G [1, i], the mth largest element 
in y[l,i] is less than or equal to the mth largest element in iu[l,i]. If 
y < w, we write [y, w] for the Bruhat interval {x & Sd\y < x < w}. 
We now come to the key definition. 

Definition. If y < w in Sd, we say that i G [1, d] is cancellable for the 
interval [y, w] if y{i) = w{i), invj(?/) = invj(u'), and Invj(y) = Invj(w). 
(Clearly any two of these conditions imply the third.) 

The reason for the name 'cancellable' is that Bruhat order and Kazhdan- 
Lusztig polynomials are preserved under the operation of 'cancelling 
the common action on V from the permutations in question, in the 
following sense. For all i G [1, d], let Oi : [1, d] \ {i} — > [1, d — 1] be the 
unique order-preserving bijection. For w G Sd, we define w % G Sd-i by 

w % = a w (i) owo a' 1 . 
It is clear from either formula in (J2.1)) that 

(2.3) £(w") = £{w) - mvi(w) - Inv.H. 

The following result combines Lemmas 17 and 39 of but we will 
spell out the proof for later reference. 

Proposition 2.2. Suppose that i is cancellable for [y,w]. 

(1) For any x G [y, w\, x{i) = y{i) and invj(x) = mvi(y). Hence i 
is cancellable for any sub-interval of [y,w]. 
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(2) x i— > x % is an isomorphism of po sets between [y,w] and [y\w % ], 
which reduces all lengths by the same amount. 

(3) For any u,v G [y,w], P U)V = P^y. 

Proof. Set j = y{i) = w(i), m = vnVi(y) + 1 = invito ) + 1, and suppose 
y < x < w. Now y[l,i] and io[l,z] each have exactly m elements 
> j and 771 — 1 elements > j. By Proposition 12. 1| the same is true 
of x[l, i}. Similarly, y[l, % — 1] and w[l, % — 1] each have exactly m — 1 
elements > j and m — 1 elements > j, so the same is true of x[l, i — 
Thus x(i) = j and inv,(x) = m — 1, proving (1). Moreover, it is clear 
from Proposition 12. II that y % < x % < w\ The construction of the map 
[y l , w 1 } — > [y, w] : x i— > x inverse to x h- > x* is easy: 

j, if z' = z, 



<Tj\x{<Ti{i'))), iil'^l. 



This proves the isomorphism part of (2), and the statement about 
lengths follows from (1). In light of parts (1) and (2), it clearly suffices 
to prove (3) in the case u = y, v = w. We prove this by induction on 
£(w), it being trivial if w — 1. Choose one of the Coxeter generators, 
say s, such that ws < w. We now have three cases. 
Case 1: s — Sj_i. This means that w(i — 1) > j, so w[l,i — 2] has 
only m — 1 elements > j. Therefore the same is true of y[l, i — 2], so 
y(i — 1) > j, i.e. ys < y. Moreover, ws[l, i — 1] has only m — 2 elements 

> j, so y ^ tos. Under these circumstances we have (see (|2.5j) below) 

(2.4) ^y,w Pys,ws- 

Obviously i — 1 is cancellable for [ys,ws], so by the induction hypoth- 
esis, Py S!WS = P( ys y=i t ( ws y=i- But (ys) 1 - 1 = y l and {wSi- X ) l ' x = w\ so 
we have the result. 

Case 2: s = s^. This means that w(i + 1) < j, so w[l,i + 1] has 
only m — 1 elements > j. Therefore the same is true of y[l,i + 1], so 
y(i + 1) < j, i.e. ys < y. Moreover, ws[l,i] has only m — 1 elements 

> j , so y j£ ws. The proof proceeds as in Case 1, with z + 1 in place of 
z - 1. 

Case 3: s ^ Sj-i, Sj. The fundamental recursive property of Kazhdan- 
Lusztig polynomials (0 Section 7.11, (23)]) tells us that 



(2.5) P y , w = P y >, W s + qPy>s, W s- K^^)Q Ww) ~ m)/2 P, 



y,z-> 



y<z<ws 
zs<z 



where n(z,ws) is the coefficient of g( £ ( lu *)" £ ( 2 ) -1 )/ 2 in P z>ws , and y' is 
the minimum of y and ys in Bruhat order. All the nonzero Kazhdan- 
Lusztig polynomials involved in the right-hand side are indexed by 
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elements of the interval [y',ws], for which % is cancellable. By the 
induction hypothesis, they can all be replaced by the analogous poly- 
nomials for the interval [{y') 1 , (ws) 1 ], and the result follows. □ 

We now recall (and extend slightly) the matrix notation used in 26J. 
Let (foj)i G [i, n ] be an n-tuple of nonnegative integers whose sum is d, and 
let (cj)j£[i jn >] be an n'-tuple of nonnegative integers whose sum is also 
d. To avoid notational clutter, we make the convention for the rest of 
this section that the range of the variables i and i' will be [1, n] unless 
otherwise specified, and that of the variables j and j' will be [l,n']. 
We will use boldface letters such as m and m' for the (n x n')-matrices 
whose entries are written with the corresponding ordinary letters m^j 
and m! i y Let M^y^) be the set of all (n x n')-matrices m satisfying: 

(1) rriij G N, for all 

(2) J2j m i,j = bi, for all i, and 

(3) J2i m i,j = c v for a11 3- 

If any 6, or Cj is 0, the corresponding row or column must always be 
zero and is therefore irrelevant, but it will be convenient to allow this 
possibility. We will use an obvious notation for the sums of various 
sectors of a matrix: 

m <i,>j = ^2 m i',j'i m <i,j = S ^2 m i',j-> m i,>j - y^ m M'; 
i'<i i'<i 

and similarly m>t,<j, etc. Note that for m e M^.).^.), 

m>i <j = ci + c 2 H h cj - m<i_i <,- 

2.6 " I ~ \ 

= ci H \-Cj-b-i 6i_i + m<i_ 1: > j+1 . 

The matrices in M( b .).( Cj ) parametrize double cosets of Sd with respect 
to certain parabolic subgroups. Namely, write [1, d] as the disjoint 
union of blocks Bi, ■ ■ ■ , B n such that all elements of are less than 
all elements of B i+ i, and \B{\ = b{. (Because we are allowing some 
bi to be zero, some of these blocks could be empty.) Let S^) be the 
subgroup of Sd which preserves each Bi separately; this is a parabolic 
subgroup isomorphic to Sb 1 x • • ■ x S& n . Similarly define blocks Cj of 
sizes Cj, and the parabolic subgroup S( Cj y We define a surjective map 
t/j : S d -> M (6 . );(c .) by 

ip(w) itj = \w(Bi)f]Cj\. 

The fibres of ip are exactly the double cosets S^wS^), so ip induces 
a bijection S( Cj) \S d / Sq,^ <-> M (bi);(c .). For m e M (bi);(Ci) , let w m G S d 
be the longest element in the corresponding double coset. 
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Note that in the case when n = n' = d and all hi — Cj — 1, the par- 
abolic subgroups are trivial, and we have merely passed from elements 
of Sd to the corresponding permutation matrices (or their transposes, 
depending on your convention). In general, the permutation w m can be 
constructed from the matrix m as follows: assuming that the images 
of Bit for i' < i have been determined, we send successive various-sized 
sub-blocks of Bi to the various CjS, according to the entries of the ith 
row of m read from right to left. Within each sub-block, we succes- 
sively take the largest element of Cj still unused. More formally, if a is 
the sth element of B iy then w m (a) G Cj where j is maximal such that 
m i,>j > s - Specifically, w m (a) is the tth largest element of Cj where 

(2.7) t = m<i-i tj + s - m i: > j+1 . 

Example. Take d = 9, n = n' = 4, and define b i: Cj so that 

B 1 = {1}, B 2 = {2, 3, 4, 5}, B 3 = {6, 7, 8}, B 4 = {9}, 
d = {1, 2}, C 2 = {3, 4, 5}, C 3 = {6, 7, 8}, C 4 = {9}. 

Let us construct w m where 



(I 








0\ 


1 


2 


1 








1 


2 





V° 








V 



The first row tells us that w m (l) is an element of C\\ we take the largest 
element, namely 2. The second row tells us that w m (B 2 ) consists of 
one element of C3, two elements of C 2 , and one of C±, in that order. 
Taking the largest elements not yet used, we set w m (2) = 8, w m (3) = 5, 
w m(4) = 4, and u> m (5) = 1. Continuing in this way, we see that w m is 
the permutation 285417639 (in 'one-line' notation). 

We define a length function £ : M( bi ).( c .) — > N by £(m) = £(w m ), and 
a partial order on M( b .).( Cj ) by 

111 < 111' u; m < ty m / . 

These can be described as follows. 

Proposition 2.3. Let m, m' G M^y^y 

(1) *M = V,, ; ,, , - (T 1 )- 

(2) m < m' z/ and on/y i/ ; /or a// i, j, 

m <*,>i < m <i,>i- 

(3) m < m' if and only if, for all 

m >i,<j < m >i,<j- 
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Proof. Let a be the largest element of Bi nw; m 1 (Cj). Then for 1 < k < 
m it j, a — k + 1 is the fcth largest element of B { fl w^{Cj). Clearly 

(2.8) inv a _ fc+ i(u; m ) = m<i,>j - k. 

Summing this over all i, j, and 1 < k < rriij gives (1). To prove (2), fix 
i and j, and let b be the largest element of Uj'<j.Bj/ and c the smallest 
element of ^j'>jCj>. If m < m', then by Proposition 12.11 we have 

| {a < b | w m (a) > c}\ < \{a < b \ w m r(a) > c}\, 

which exactly says that m< it >j < m<j > ■. Conversely, suppose we know 
that ni< it >j < m' <i> j and rn<i-\,>j < m<i-i >,•• For all 1 < k < bi, we 
have 

(2.9) | {a < b — k + 1 | w m (a) > c}\ = ma.x{m< it >j — k + l,m<j_i>j} 
and similarly for m', so our assumption implies 

\{a < b - k + 1 1 w m (a) > c}\ < |{a<6-A; + l| w m ,(a) > c}\. 

Combining these statements for all j tells us that for all m, the mth 
largest element of u> m [l, b—k+l] lies in a block Cj prior or equal to that 
containing the mth largest element of ww[l, b — k + l]. Remembering 
how w m and w m > are constructed from m and m', this implies that 
for all m, the mth largest element of w m [l,b — k + 1] is less than or 
equal to the mth largest element of ww[l, b — k + l]. Letting i and k 
vary, we get w m < w m i by Proposition 12.11 so (2) is proved. One way 
to deduce (3) from (2) is to use (|2.6j) . Another way is to recall that 
w m < w m i if and only if < w m'i clearly the inverse of w m is the 
permutation w m t associated to the transpose matrix m* e M( Cj ).( fe .), 
and the condition in (3) is the transpose of the condition in (2). □ 

We can also define Kazhdan-Lusztig polynomials indexed by pairs of 
elements of M^y^y. P m , m > = P Wm ,w m ,- By definition we have 

(2.10) P m ,m' 7^ =3- m < m', and P mjm = 1. 

So the inverse matrix (i 3 iy)m,m'eM !b . )i(c . ) of (P m , m ')m,m'eM (ii);(Ci) has 
entries in Z[g] which also satisfy (J2.1(J|) . In fact, we can express these 
entries in terms of those of the original matrix, as follows. Recall the 
Kazhdan-Lusztig inversion formula (0 Section 7.14, (24)]): 

(2.11) ^ X y) P x W \?\y W \? P ^ = S VW 
x£S d 

where e(z) = (— 1) £ ( 2 ) and is the longest element of Sd- Using 
the fact that P x ,w m „ = Px',w m „ for all x' 6 S^xS^) ([9 S Section 7.14, 
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Corollary]), we get 

( 2 - 12 ) P mm'= 5" e(xW m )P W W . 

A general Kazhdan-Lusztig polynomial -Py jU) , y,w E Sd, can be ex- 
pressed in the form P m , m > in various ways. The most trivial takes 
n = n' = d and all hi = Cj = 1, so that there is no difference be- 
tween permutations and matrices. At the other extreme of usefulness, 
we can take (Bj) to be the collection consisting of the maximal in- 
tervals on which w is decreasing, and (Cj) the same thing for w~ l . 
With these choices, w is clearly the longest element in its double coset 
S( c ,)wS(bi), so P VjW depends only on the double coset of y\ in other 
words, P y>w = P^( y ),i,(w) where ip : Sd — > Mq,^) is as above. 

Example. Let y = 128456379 and w = 587429316 in S 9 . The blocks 
Bi and Cj determined by w are exactly those used in the previous 
example. Indeed, w = w m i where 

/0 1 o o\ 

112 
110 1 
\0 1 0/ 

Now ip(y) is the matrix m from the previous example, so the permuta- 
tion w m = 285417639 found there is the longest element in the double 
coset S( Cj )yS(bi)- Using the criteria in Proposition 12.31 it is easy to 
check that m < m'. The above principle means in this case that 

Py,w Pm,m! -^ui m ,u;- 

The advantage of the latter form is that 2 is cancellable for [u> m ,u>]. 
Since = 25417638 and w 2 = 57428316, we get P V;W = ^25417638,57428316 

In order to be able to perform such a cancellation directly on matri- 
ces, we note the following. 

Proposition 2.4. Let m 6 M^y^, a G Bid w^(Cj). Let e he the 
matrix with e^j = 1, all other entries zero. 

(1) = w m _ e - 

(2) £(m) — £(m — e) equals each of the following: 

m <i,>3 + m >i,<3 - m ij - 1 = m <i~h>j + m >i+l,<j + b i ~ 1 

- m <i,>j+l + m >i,<j-l + C j ~ 1- 

Proof. Part (1) is clear from the explicit construction of w m given 
above, and (2) follows easily from (1) of Proposition 12.31 □ 
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Definition. If m < m' in M^).^.), we say that G [l,n] x [l,n ; ] 
is cancellable for the interval [m, m'] if 

(1) m it j > 1. 

(2) m<i-\ t >j = m'<i-i,>j, or equivalently m> it <j-i = , m > >i t <j-i- 

(3) m< i; > i+ i = m^^j+j, or equivalently m>i + i,<j = ^>i+i,<j- 

These equivalences follow from ()2.6j) . 

Proposition 2.5. Suppose that m < m' m M^).^.) and (z, j) can- 
cellable for [m, m']. Let e be the matrix with ejj = 1, a// ot/ier entries 
zero. 

(1) For ant/ m 1 G [m, m'], 

(a) mjj > m lJ , 

(b) m^^j = m<i_i t >j, and 

(c) ™<i,>i+l = "l<i,>i+l. 

Hence is cancellable for any sub-interval o/[m, m']. 

(2) TTie map m 1 i— > m 1 — e is an isomorphism of posets between 
[m, m'] and [m — e, m' — e] , which reduces all lengths by the 
same amount. 

(3) For any m 1 , m 2 G [m, m'], P m i, m 2 = P m i_ e ,m2-e- 

(4) For any m 1 , m 2 G [m, m'], P^i m 2 = 0-e.ma-e- 

Proof. Let m 1 G [m, m']. By (2) of Proposition 12.3^ we have 

m <i-i>i < m <i-i,>i ^ m <i-l,>i = m <i-h>v 
which proves (lb), and (lc) is similar. It follows that 

m lj ~ m ij = ( m l,j + m <i-l,>j + m <i,>J+l) ~ ( m iJ + m <i~h>3 + m <i,>j+l) 
= ( m <i,>j + m <i-l,>i+l) - ( m <i,>3 + m <i-h>j+l) 
= ( m <i,>j ~ m <i,>j) + ( m <i-l,>j+l ~ m <i-h>j+l) 

>o, 

by Proposition 12.31 again. So (la) is proved. Thus m 1 — e G M^.,~y 
where 

bi' = bi' — Sa' , Cji = Cji — 

Given this, the first part of (2) is obvious from either description of 
the partial order given in Proposition 12.31 and the second part from 
(2) of Proposition 12.41 To prove (3), let a be the largest element of 
Bi fl w^-(Cj), i.e. the (m it >j)th element of B^ We want to show that 
a is cancellable for [w m , w m >]. Let 

6 = m i,>j ~ m ^>i = m '<iJ ~ m <iJ = m '<i,>j ~ m <i>i ^ °- 
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(These are equal because is cancellable, and nonnegative because 
m < m'.) By the above chain of equalities applied to m 1 = m', we 
have 

m 'i,j ~ m i,j = 6 + ( m '<i-i,>j+i ~ m <i~h>j+i) > ^ 

so 

m 'i,>j+l = m i,>j - m 'i,j = m i,>3 + S ~ m i,j < m i,>j < m i,>j> 

which means that w m >(a) G Cj. From (|2.7|) we see that w m r(a) = 
w m (a). Moreover, 

inv a (w m ) = m< K >j - 1 = m'^j -5-1 = inv a (w m /), 

so a is cancellable for [u> m ,u> m ']. In particular, for any m 1 G [m, m'], 
w m i(a) G Cj, which by (1) of Proposition 12.41 implies = w m i_ e . 
Then part (3) follows from (3) of Proposition 12.21 and part (4) follows 
formally from parts (2) and (3). □ 



Example. With matrices m, m' defined as in previous examples, (2, 3) 
is cancellable for [m, m'], corresponding to the fact that 2 is cancellable 
for [w m , w m >}. Performing the cancellation directly on the matrices, we 
get 



m 



/l 
1 





o\ 






m 



/o 
i 
i 



o\ 



1 



The reader can check that these matrices correspond to the permuta- 
tions 25417638 and 57428316 found earlier. 



3. NlLPOTENT ORBITS OF THE LINEAR QUIVER 

We now return to the set-up of the first part of the introduction, 
so V is a c?-dimensional Z-graded vector space, with d{ = dimV^. For 
convenience, we adjust the grading so that di ^ =3- i G [1, n], for some 
positive integer n (so we are effectively considering the linear quiver of 
type A n ). Throughout this section, the variables i,j range over [l,n] 
unless otherwise specified. 

We saw in §1 that the Gy-orbits in My are in bijection with the set 
M(d.) of multisegments in which i occurs di times as an element of a 
segment. Following 26 , we change this parametrization by multiseg- 
ments to a parametrization by matrices. We identify each m G Mu^ 
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with the (n x n)-matrix (uiij), where 
(3.1) 

{multiplicity of the segment if i < j, 

number of segments [k, I] where k < j , I > i, if j — % — 1, 
0, ifj<z-l. 

It is clear that this matrix lies in the set M^i);(d ): as defined in the 
previous section. So we have identified with a subset of M^.^y, 
which can be described as follows. 

Proposition 3.1. Let M',^ = {m G M^y^dj) \ fn%,j = 0, Vj < i — 1}. 

(1) ML-, is a lower ideal of the poset M( di y^ dj y 

(2) If m G M', d ,y then for all i > j , m<i t >j = dj + dj + i + • • • + dj. 

(3) For m, m' G M', di y m < m' if and only if m<i,>j < wi<j >j /or 
a// z < j . 

(4) If m G M', d ,y then for all i G [2, n], m^-i = m<j_ l5 >j. 

(5) M^^M^). 

Proof. An element m G M^y^dj) lies in M,'^ if and only if m>i t <j = 
for all i, j such that j < 2 — 1, so (1) follows from (3) of Proposition 
12.31 For (2), since rn>i+i,<j-i = 0, (|2.6|) gives 

m <i,>j — di + h di — d 1 — = dj + • — h di, 

as required. Part (3) then follows from (2) of Proposition 12.31 For (4), 
we have 

m M _i = di- m it >i = m< it >i - m it >i = m<i- h >i. 

From (4) and the i = j case of (2) it follows that every matrix in ML.^ 
arises from a multisegment in by the rule (|3.1|) . whence (5). □ 

As mentioned in the introduction, the identification of with M', d ,^ 
is a poset isomorphism: the geometrically-defined partial order ^ on 
M(^) is the restriction of the partial order < on Mf^yu.y This is part 
of Zelevinsky's result fZG\ Corollary 1], which we can state (with some 
supplementary detail) as follows. 

Theorem 3.2. Let m, m' G M^y 

(1) dim 0^(m) -£«(*). 

(2) O m C0^^ m < m'. 

(3) WIC{p^) = fori odd. 

(4) IC m m i = P u 



m,m' 



rni- 1 ) — pi- 1 ) 

\°J J °m,m' ~~ - r m,m" 
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Proof. For reference in §5, we recall Zelevinsky's proof. Define the par- 
tial flag variety Bu^ to be the set of collections of subspaces (Wj)i e ro !n i 
of V such that W = 0, and for all i G [l,n], Wi-\ C Wi and 
dimWi/Wi-i = di, this is naturally a nonsingular projective variety 
of dimension — £\ (*\. We define a 'base-point' (Ui) in by 
C/j = V\ © • • • © V*. Relative to this base-point, B^) decomposes into 
Schubert cells B m for m G M( d .y^ d .y Explicitly, i3 m consists of those 
(Wi) such that for all i,j G [l,n], 

Wj n ^ 
n u 3 -x + Wt-i n £/,■ ~ miJ '" 

The analogues of (l)-(4) for these Schubert cells (for all of M^y^)) 
are well known. Let B',^ be the closed subvariety of B^) defined by 
requiring Wi D U{-i] from the description of M( rf .) as MLs, it is easy 
to see that B[ di) = \J m eM {d . } B ™- 

Now we define a morphism My — > Bi d ^ : <£> i— > (Wj (<£>)) by the rule 

Wi(<p) = Ui-i ®{v + <p(v) + ip 2 (v) + ■■■ + ^(v) | v G Vi}. 

An easy check shows that this morphism maps O m into B m for all 
m G Mtd-y Moreover, it gives an isomorphism between My and the 
open subvariety of B', d .s defined by requiring 

Win0^ = o, V* G [l,n]. 

i'>i 

Hence each m is embedded as an open subvariety of the Schubert cell 
B m , and (l)-(4) follow. Since M^) is a lower ideal of M^y^dj), (5) is 
an automatic consequence of (4). □ 

In view of (3) of Proposition 13.11 part (2) of Theorem 13.21 says that 
m C O m i if and only if for all i < j, ?n<i,>j < m '<i,>j- Now if tp G O m , 
then for i < j, m<i^>j = rk<£> J-i |y r So we recover the well-known fact 
that O m C O m i if and only if for all i < j, rk(p j ~' l \ Vl < rk ((p'Y~ % \vi 
for any <p G O m and G CW- (Of course the "only if" direction 
is obvious.) We can define an element m max G Mua uniquely by the 
requirement that for i < j, m<f>^ equals the maximum possible rank, 
namely min{dj, g^ + x, ■ • • , dj}. It follows that m < m max for all m G 
M( d .), and the orbit O m max is dense in My- 

As foreshadowed in the introduction, Theorem 13.21 is only one of 
many possible ways to express a particular /C mm / as a Kazhdan- 
Lusztig polynomial: the below-diagonal entries prescribed by (j3.1[) cor- 
respond to one particular choice of "empty segments" . A more general 
statement is the following. 
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Theorem 3.3. Let bi, ■ ■ ■ , b n , c\, ■ ■ ■ , c n G N be such that 

h = di, c n = d n , and dk - h = di-i - Cj_i, Vz G [2, n]. 
Define an (n x n) -matrix a fry 

a . . = / di - 6», if 3 = i - 1 > 
l ' J 1 0, otherwise. 

Let M ( ( g ;fe) = {m G M (dj) | m M _! > tfc - 6 i? Vz G [2, n]}. 

(1) M,^\ J is an upper ideal of M^y 

(2) Tne map m k m - a is an isomorphism of posets between 
Mg} ;(Cj) ana 1 {m G M (6 . );(c .) | my = 0, Vj < i - 1}. 

(3) For any m',m" G M^ 5 , IC m ,, m „ = P m >_ a , m »_ a . 

(4) For an?/ m',m" G M<g ;(c ^ JC&J^ = P^m-a- 

Proof. For m G Mt^y equals m^^j-i, so (1) follows from (3) of 

Proposition 12.31 For (2), the fact that the given map is a bijection is 
obvious, and by Proposition 12.31 it preserves partial orders. Now this 
map is the composition of maps of the form m i— > m — e as in Proposi- 
tion |23] and their inverses m i— > m + e, where the positions which are 
being altered are all of the form (i,i — 1). Since all matrices involved 
have zero entries in positions (i, j) where j < i — 1, conditions (2) and 
(3) of the definition of cancellability always hold. So Proposition 12.51 
implies (3) and (4) with P m > jia " and P^m" in place of LC m > m » and 
^m'm"' an d Theorem 13.21 gives the result. □ 

Corollary 3.4. For m G Mua, define an (n x n)-matrix m~ by 



m,j, if 3 = i - 1, 



% j 1 0, otherwise. 

Let (m) = {m' G M (d .) | m < m'} = [m, m max ]. 

(1) For all m' G (m), m' - in G M ((ii _ mM _ l);(dj _ m . +1 i) . 

(2) The map m' i— > m' — m~ is an isomorphism of posets between 
(m) and [m — m , m max — m ] . 

(3) For any m',m" G (m), LC m i m ii — P m '-m- ,m"—m- 

(4) For any m', m" G (m), LC^L, = P^ _ „ 

\ / y ' \ / ' m',m" m— m ,m"— m 



Proof. Apply Theorem 13.31 with 

bi — di — m^i-i, Ci_i = dj_i - m^j-i 
for all i G [2,n], and restrict to the upper ideal (m) of M,^\ . □ 
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Note that the polynomials -P m '-m-,m"-m- m (3) are Kazhdan-Lusztig 
polynomials for 5fc( m ), where k(m) is the number of segments of m, 
which is also the sum of the entries of m — m~ . 

Finally, we have to connect Theorem 13 .31 to the notation of the intro- 
duction, in order to prove Theorem ll.il We have elements A,/i G D/.] 
we can clearly assume that all X s — s, /i s — s + 1 for 1 < s < k lie in 
[l,n]. Define 

k = \{s | fM s - s + 1 = cj = \{s\X s - s = j}\. 

Then the subgroups S^) an d S7 C ) of Sk are exactly the conjugates 

(k) 

under Wq of the dot stabilizers and W\ (this reversal comes about 
because the sequences (A s — s) and — s) are decreasing). The map 
ip '■ Sk — > M( b -).( Cj ) as defined in the previous section satisfies 

(3.2) ifj(w ( Q ) ww i k) )i ij = \{s\ fi s - s + 1 = i, A t0 ( s ) - w(s) = j}\. 

So Sf.[X, fi] = {w e S k \ tP{wqWWq )ij = 0, Vj < i — 1}, which shows 
that it is indeed a lower ideal of Sk- Moreover, w h- > ^(w^ww^) gives 
an isomorphism of posets between ^[A, fj]° and {m e M^i);{cj) I ™>i,j — 
0, Vj < and the polynomials attached to these posets correspond, 

since 

(3.3) P w>ul , = P w W ww (k) !W ( k ) w , w (k) = ^M^M^^M^)) 

for all w,w' G Sk[\,[i}°. Now as in Theorem assume that A//i G 
Mua] it follows immediately that (foj) and (cj) satisfy the conditions 
of Theorem 13.31 By ([3.2)1 . for all w G Sk[\,fi}°, the multisegment 
X/(w - fi) when viewed as a matrix has the same diagonal and above- 
diagonal entries as ^(wqWWq ); hence X/(w ■ //) = iJ)(wq ww^ ) + a 
where a is as in Theorem 13.31 Thus Theorem 11.11 follows from Theorem 
ET31 



4. Cancellation for the affine symmetric group 

We now want to extend the results of §2 to the affine symmetric 
group. Again fix a positive integer d. Let Sd be the group of permu- 
tations w of the set Z such that w(i + d) = w(i) + d, for all i G Z. 
An element w G is determined by its window (w(l),w(2), • • • , w(d)), 
which can be any collection of representatives of the congruence classes 
mod d, in any order. The subgroup of Sd which preserves [1, d] is clearly 
isomorphic to Sd- 
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The group Sd is the 'extended' affine symmetric group: it can be 
written as a semi-direct product (r) K Sd, where 

d d 

S d = {w E S d \ y]w(i) = J^i} 

i=l i=l 

is the actual affine symmetric group, and r is the element of infinite 
order sending % to % + 1 for all i 6 Z. In general, u> G T a ^Sd where 

a i=i i=i 

Note that for any i G Z, the set iu(— oo,i] can be obtained from 
(— oo,i + a(w)] by changing finitely many elements (keeping distinct- 
ness). In other words, for m sufficiently large, the mth largest element 
in w(— oo, i] is i + a(w) — m + 1. 

If d = 1, Sd is the trivial group and Sd — (r). If d > 2, we define 
Sj G S'd for alH G Z by 

{j + 1, if j = « mod d, 
ifj = i + lmodd, 
j, otherwise. 

Thus Si = Si> iff % = %' mod d. It is well known that Sq, s±, ■ ■ • , Sd-i form 
a set of Coxeter generators for Sd of type A d -\. They thus determine 
a length function £ : Sd — > N, a Bruhat order < on S^, and Kazhdan- 
Lusztig polynomials P y>w G for y,w G S^, all of which are invariant 
under conjugation by r. We extend these to Sd in the standard way: 

£(w) =£{r- a ^w), 
y<w^ a(y) = a(w), T~ a( - y) y < r- a{w) w, 

P = I P T-(y)y,T-^) w , if a (y) = a M> 
y,w \ 0, otherwise. 

We define inversion statistics as in the finite case: 

invj(w) = < i | w(i') > w(i)}\, Inv,(u>) = > i \ w(i') < w(i)}\, 
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for any w G Sd and i 6 Z (these sets are finite, even though i' runs 
over Z.) Clearly mv i+d (w) = invj(iy), lnv i+d (w) = Invj(w), and 

Invj(w) — mvi(w) 

= |(— oo, w(i)] \w(— oo,i]\ — \w(—oo,i] \ (— oo, w(i)]\ 

= | (—00, \ (— 00, i + a(w)]| - |(— 00, i + a(w)] \ (— 00, w(i)]\ 

= w(i) — i — a(w). 

The formula for i on Sd is analogous to that for Sd (see |U Proposition 
4.1(h)]): 

(4.1) = V] invi(w) = ^2 Inv i(^)- 

«G[l,d] i£[l,(i] 

We also have 

(4.2) wsi < w if and only if w(i) > w{i + 1), 

and a general description of Bruhat order along the lines of Proposition 
12.11 (this is a rephrasing of [H Theorem 6.5], trivially extended from S d 
to S d ): 

Proposition 4.1. Ify,w G S^, y <w if and only if for alii G Z ; 
|{z' < i I y(z') > j}\ < < i I ty(z') > j}|, Vj, mt/i equality for j <^ 0. 

In other words, for all positive integers m, the mth largest element in 
y(— 00, i] is less than or equal to the mth largest element in w(—oo,i], 
with equality for m 3> 0. It suffices to check this for % G [1, d]. 
The definition of cancellability is identical to the finite case: 

Definition. If y < w in Sd, we say that i G Z is cancellable for the 
interval [y, iw] if y(i) = w(i), invj(y) = invj(w), and Invj(y) = Invj(w). 
(Clearly any two of these conditions imply the third, and % is cancellable 
for [y, w] iff i + d is.) 

However, the process of cancellation is not as uniquely defined as in the 
finite case: we need to choose order-preserving bijections 07 : Z\z — > Z 
for all congruence classes i mod d. Then for any w G Sd, we define 

w l G S d -i by 

w l = ctttt w o 

Note that using different cr's would have the effect of multiplying w ! on 
left and right by powers of r. Independently of the choice, we have 



(4.3) 



l{w l ) = £(w) — invj(w) — lnvi(w). 
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Example. Take d = 3, y = TS1S2 and w = TS2S\SoS2- Then y has 
window (3, 4, 2) and w has window (0, 7, 2). Since inv 3 (?/) = inv 3 (w) = 
2, 3 is cancellable for [y, w]. If we normalize o ■§ and erg by requiring that 
they preserve 1, then y 3 and u> 3 are the elements of 5*2 with windows 
(2,3) and (0,5), namely r and tsiS . 

We can now extend Proposition 12.21 to the afhne case. 

Proposition 4.2. Suppose that i is cancellable for [y,w\. 

(1) For any x G [j/,ti!], x(i) = y(i) and inv,(x) = invi(y). Hence i 
is cancellable for any sub-interval of [y, w] . 

(2) x I— > x l is an isomorphism of po sets between [y,w] and [y l ,w l ], 
which reduces all lengths by the same amount. 

(3) For any u,v G [y,w], P U:V = P^y. 

Proof. The proof of part (1) is identical to that of part (1) of Proposi- 
tion with replaced by (— 00, i] and so on, and of course using 
Proposition 14.11 instead of Proposition 12.11 Similarly with part (2), 
where the inverse map [y l , w % ] — > [y, w] : x 1— > x is now defined by 

, f y(i) + kd, if i' = i + fcc?, 
5(0 = \ <^fo(i'))), if*'*i. 

The proof of (3) is also mostly unchanged. Apart from replacing [l,z] 
by (—00, i] and so on, the only change is that in Case 1, we need not 
have {ysY^ 1 = y l and (ws)'" 1 = w l , but rather have 

(ys) rT = rVA r a w I r b for some a, b G Z, 

which still implies ^ (2/s) i=t (tiJs) T=T = ^i )W i as required. □ 

We now introduce some affine matrix notation very similar to that 
in [Tl]. Let {bi)i^% be a Z-tuple of nonnegative integers, periodic with 
period n > 1, such that ^™ =1 6, = d; and let (cj)j g ^ be another such, 
with period n' > 1, such that X]j=i c i = ^- O ur notational convention 
now is that the range of the variables is all of Z unless oth- 

erwise specified. Let M( b .^ n .( c .^ n / be the set of all (Z x Z)-matrices m 
satisfying: 

(1) m it j G N, for all i, j, 

(2) m i+n>j+n > = rriij, for all i,j, 

(3) J2j m i,j = hi, for all i, and 

(4) J2i m i,j = c h for a11 J- 

It is easy to see that for m G M( 6 .) n; ( Ci ) n /, m it j = for \j — i\ ^> 0; so 
sums of the form m<ij, Tn< it >j and m>i t <j are finite. We have 
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the following substitute for (|2.fijl . For fixed i, m>i } <j = for all jo 
sufficiently negative, and for j greater than such j , 

(4.4) rn>i,<j = c jo+1 H \-Cj- m<i- h > jo+ i + m<i_i ; > i+1 . 

The matrices in Mq,^^-^.)^ parametrize double cosets of Sd with 

respect to proper parabolic subgroups of Sd- Namely, write Z as the 
disjoint union of (possibly empty) blocks Bi such that all elements of 
Bi are less than all elements of -B«+i, and \B$\ = bi. It follows that 
B i+n = Bi + d. Note that the collection (Bi) is determined by (bi) 
up to translation (i.e. a power of r). Let S(ba be the subgroup of Sd 
which preserves each Bi separately; this is a parabolic subgroup of Sd 
isomorphic to S 1 ^ x • • • x Sb n - (It is determined by (bi) up to conjugation 
by a power of r.) Similarly define blocks Cj of sizes Cj, and the parabolic 
subgroup S(Cj)- We define a surjective map ip : Sd — > A^(6i),n;(cj),n' by 

^(w)vi = \w(Bi)nCj\. 
The fibres of ip are exactly the double cosets S(Cj)wS(Bi), so ^ induces 
a bijection S( Cj )\S d / S {Bi) <-> M( 6i)i „;( Cj)) „/. For m G M (6i)in;(Cj)in /, let 

G 'S'd be the longest element in the corresponding double coset. 
The permutation w m can be read off the matrix m by exactly the 
same prescription as in the finite case (remembering that i, now 
range over all of Z). 



Example. Let d = 7, n = 2, n' = 3, and define 

3, if i = 1 mod 2, J ' . _ 
a -c ■ n i r) c, : = < 2, it j = 2 mod 3 

4, if z = mod 2, | 2 

Let m e M( 6 .) 2 ; ( Cj ) i 3 be the following matrix: 



if j = 1 mod 3, 
if j = 2 mod 3, 
if j = mod 3. 



200001000000 
020001000000 
100200001000 
000020001000 
000100200001 
000000020001 
000000100200 



where the is the (1, 1) entry. We choose (Bi) and (Cj) so that B\ = 
C\ = {1,2,3}. The row containing tells us that w m (Bi) consists of 
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one element of G% = {13,14} and two of Gi = {4,5}, in that order. 
Since the (0,6) entry is 1, the largest element of C 6 'has already been 
used' in w m (B ), so we set w m (l) = 13, w m {2) = 5, u> m (3) = 4. 
Treating the next row similarly, we find that w m is the element of Sj 
with window (13,5,4,21,10,9,1). 

We define a length function £ : M( b .) jn; ( Cj .) jn / — > N by £(m) = £(w m ), 
and a partial order on M^ >n .^ Cj ^ n i by 

m < m' w m < w m i. 

Since the map m i— > w m depends on the choice of (Bi) and (Cj) only 
modulo left and right multiplication by fixed powers of r, these defini- 
tions are independent of this choice. Indeed, they can be described in 
an analogous way to Proposition 12.31 

Proposition 4.3. Let m, m' £ Mn,.-) >n ./ c .) >n > . 

(1) «(m) = V, . ; - EfcMj 

(2) m < m' if and only if, for all i £ Z ; 

m <i,>j — m '<i,>j> ^7) ^i/i equality for j <C 0. 

(3) m < m' z/ and on/?/ z/ ; /or a// j £ Z, 

m >i,<j — m '>i,<ji with equality for i <C 0. 

Proof. The proof is mostly identical to that of Proposition 12 .3^ using 
(14. lj) and Proposition 14.11 instead of ()2.1j) and Proposition 12.11 In the 
proof of (3), the argument using ()2.6|) no longer makes sense, but the 
argument using transposes does. □ 

As in §2, we define P m , m / = P Wm ,w m , for m, m' £ M^n^n' ■ From 
(2) of Proposition 14. 31 it is clear that each interval [m, m'] in the poset 
M^n-^n' is finite, so the inverse matrix (P^,)m,m'eM (i ,. ))ft . (e . )jn , of 
(Pm,m')m,m'eM (il . )in . (c . )i „, is well defined. 

The matrix definition of cancellability is identical to the finite case. 

Definition. If m < m' in M^.)^.^.)^/, we say that £ Z x Z is 
cancellable for [m, m'] if 

(1) m i;j > 1. 

(2) m<i- 1: >j = ^<j_i,>j, or equivalently m> i) < j+1 = ^>i,< J+ i- 

(3) m< it > j+1 = m'< i} > j+1 , or equivalently m> i+1) <j = m'>i +1) <j- 

These equivalences follow from (|4.4jl . bearing in mind (2) of Proposition 
14.31 Clearly is cancellable iff (z + n, j + n') is. 
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Proposition 4.4. Suppose that m < m' in M^^.^y and is 
cancellable for [m, m'] . Let e be the matrix with ei + k n ,j+kn' = 1 for all 
k, all other entries zero. 

(1) For any m 1 G [m, m'] ; 

(a) m\j > m id , 

(b) "i<i_i,>j = m <i-i,>j, and 

(c) m \i,>j+l = m <i>j+i- 

Hence is cancellable for any sub-interval o/[m, m']. 

(2) The map m 1 i— > m 1 — e is an isomorphism of posets between 
[m, m'] and [m — e, m' — e], which reduces all lengths by the 
same amount. 

(3) For any m^rn 2 G [m,m'], P m i, m 2 = P m i- e ,m2-e- 

(4) For any m 1 , m 2 G [m, m'], P^^ 2 = ^!! eim 2. e . 

Proof. Completely analogous to the proof of Proposition 12.51 using the 
analogue of Proposition 12.41 □ 



5. NlLPOTENT ORBITS OF THE CYCLIC QUIVER 

We now return to the set-up of the latter part of §1, so V is a d- 
dimensional Z/nZ-graded vector space, and dj = dimV^ for all i G 
Z. We saw in §1 that the GV-orbits in J\fy are in bijection with the 
set Mfdi),n °f multisegments (in the modulo n sense) such that each 
congruence class % occurs dj times among the elements of the segments. 
As in §3, we will identify each m G M(^), n with a matrix {m^j), this 
time in M(^) jn; (d ) >n ; the definition of m^j is exactly the same as ()3.1|) . 
The resulting subset of M^i),n;(d),n is described as follows. 

Proposition 5.1. Let M" d . ) n = {m G M^^dj^n I mj = 0, Vj < 

(1) ^(di),n is a l° wer l deal of the poset M^) 

(2) For all m G M'A-, n , there is some /(m) G Z s-uc/i t/iat 

m <i>i + /( m ) = dj H h dj, Vz > j. 

(3) For m, m' m n , m < m' and onfa/ if f(m) = /(m') and 

m <i,>j — m '<i,>j f or a ^ i < 3- 

(4) M/^-j n = {m G n | /(m) = 0} is a /ou>er idea/ o/ t/ie poset 

M^i),n;(dj),n- 

(5) If m E M[ di) n , then m^-i = m<i- lt >i for all i. 

(6) M' (di)in = M w , n . 
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Proof. As in the finite case, (1) is immediate from (3) of Proposition 
14.31 (2) comes from the fact that for i > j, 

m<i,>j = dj H h di-i + m< it >i = d j+ i H h d; t + m< jt >j. 

Using this, (3) comes from (2) of Proposition 14.31 and (4) is an imme- 
diate consequence of (1) and (3). (5) is proved in the same way as (4) 
of Proposition 13.11 From (5) and the i = j case of (2) it follows that 
every matrix in ML.-. n arises from a multisegment in M^) n , whence 
(6). " □ 

We can now state Lusztig's affine analogue of Theorem 13.21 

Theorem 5.2. Let m, m' G Mua^. 

(1) dimO^(m)-E ie[M (*)• 

(2) m C0 m ^m< m'. 

(3) H' l IC(0^) = fori odd. 

(4) ICm,m' Pm,m' • 

(5) IC mm , = P mm i- 

Proof. As with Theorem 13.21 (5) follows from (4) because M^i),n is a 
lower ideal of M^^n^dAn- Parts (l)-(4) were proved by Lusztig in [T3J 
§11], but since the conventions there are slightly different, a sketch of a 
proof along the lines of the above proof of Theorem 13.21 mav be helpful. 

Form V = C((t)) Cg>c V, an d consider lattices (free C[t]-submodules 
of rank d) in V. Define £>(di),n to be the set of collections of lattices 
(M.i)i £ z such that for all % e Z: 

(1) Mt-i c M h 

(2) dim c Mi/Mi-i = di, and 

(3) Mi-n = tMi. 

It is well known that B(d t ), n has the structure of an increasing union of 
projective varieties. We define a base-point in B(di),n as follows. 
For any i G Z, let Vi denote t k V[ where k is defined by i + kn G 
{1, • ■ ■ , n}. Define 

where denotes completed direct sum. Relative to this base-point, 
B(di),n decomposes into affine Schubert cells £> m for m G M^^dj)^- 
Explicitly, £> m consists of those (M.i) such that for all i, j G Z, 

dime — — — = mjj. 
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The analogues of (l)-(4) for these affine Schubert cells (for all of 
^(d;),n ; ((i,),n) are well known. Let B', d .-, n be the closed subvariety of 
B(di),n defined by requiring M.i D A-i> dime A^i/A-i = df, from 
the description of M^),n as ^(<fi) n> ^ * s eas y ^° see ^ na ^ n = 

UmeM (d . )jn ^m- 

Now we define a morphism Afy — >■ n : </? i— > (A4i(<p)) by the rule 

jMi(^) = d-i ®{v + <p(v) + <p 2 (v) H \v e Vi}. 

(Since ip is nilpotent, this sum is actually finite.) An easy check shows 
that this morphism maps O m into B m for all m G M^i),n- All that 
remains is to verify that it gives an isomorphism between J\fy and the 
open subvariety of B', d .s n defined by requiring 

M * n Vi ' = °> Vz G Z ' 

i'>i 

The "dual" statement to this is what is proved in f2| §11] • D 

Note that in contrast to the situation in §3, the poset M^ >n may have 
more than one maximal element. 

We now come to the affine analogue of Theorem 13 .31 a generalization 
of Theorem 15.21 

Theorem 5.3. Let bi,cj G N be such that 

b i+n = h, c j+n = Cj, and di - h = di-\ - Vz, j G Z. 
Define a (Z x Z) -matrix a by 

. . f <fc - if j = i - 1, 
M 1 0, otherwise. 

Let M^ j) = {m G M {di)>n | m M _i > - Vi G Z}. 

(1) M ( ( ^ Cj) is an upper ideal o/M( di)i7l . 

(2) Tne map m i— > m — a is an isomorphism of posets between 

M S), ; n j) and I™ e I ™ij = 0, Vj < I - 1}. 

(3) For any m',m" G M^g^, JCV, m » = P m >- a> m"-a- 

(4) For any m',m" G IC { m ,%, = P^ m „_ a . 

Proof. Completely analogous to the proof of Theorem 13 .3[ using Propo- 
sition [Ql Proposition 031 an d Theorem 15 .21 in place of Proposition |2~3~1 
Proposition 12.51 and Theorem 13.21 □ 
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Corollary 5.4. For m G M^^ n , define a (7L x Z)-matrix m~ by 



m - = \ rrHj, if J = * - 1, 
^ 1 0, otherwise. 



Let (m) = {m' G ML n | m < m'} ; and /et m 1 1 nax , • • • , m ™ ax 6e £/ie 
maximal elements of (m) . 

(1) For a// m' G (m) ; m' - m G M {di _ mi ^ 1 ) i n;(d J -m J+1J ),n- 

(2) Tne map m' f— > m' — m~ is an isomorphism of po sets between 
(m) and U«=i [ m — m , m™ ax — m~] . 

(3) For an?/ m',m" G (m) ; JC m /,m" = P m '- m -, m »- m - ■ 

(4) For an?/ m',m" G (m> ; = P£? m _ m *__ m - . 



Proof. Apply Theorem 15.31 with 

bi = di — m iy i_i, Q_i = dj_i — m^j-i 



for all « 6 Z, and restrict to the upper ideal (m) of Mu l ^ . □ 

Note that the polynomials F m '-m,m"-m- m (3) are Kazhdan-Lusztig 
polynomials for Sk( m ), where k(m) is the number of segments in m, 
which is also the sum of the entries in rows 1 to n of m — m . As a 
corollary, we recover the main result of jSj: 

Corollary 5.5. Ifm < m' in Mu.\ n , and fc(m) = 2, then IC m m > = 1. 



Proof. In S*2 all nonzero Kazhdan-Lusztig polynomials are 1. □ 



Example. Let d = 6, n = 3, di = d 2 = d% = 2. Let m G Mui),3 be 
the multisegment [1,2] + [2,3] + [3,4]. Then (m) has three maximal 
elements, 

mr = [1, 6], mf x = [2, 7], and m™ ax = [3, 8]. 
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Displaying only the rows indexed by 1, 2, 3, we have 
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Settinj 


lBi = 


{{] and Cj 



that u> m -m- is the identity of S3, we find that u> m max_ 
(5, 0, 1), and is therefore SiS s 2 Si. Similarly u> m m ax -m- 



■ has window 
s 2 SiS S2 and 

w m max_ m - = s s 2 Sis . So m' 1— > w m i_ m - is an isomorphism between 
(m) and [1, S1S0S2S1] U [1, S2S1S0S2} U [1, soS2SiSo]- Moreover, 

and similarly /C mim max = IC m ^ m ^^ — q + 1, while 



IC. 



<-i> 

m,m' 



PI 



(-1) 



for all m' G (m) (an example of (jl.Sjl ). 

Finally, we must prove Theorem 11.21 We have elements X, fi G D^; 
define A s and /i s for all s G Z by the rule 

X s+ k = A s + k -n, /i s+fc = n s + k-n. 

Then X s — s > A s+ i — (s + 1) for all s G Z, and similarly for //; also, 

(W • fl) a - S = fl w -l( s ) - Vw G S'jfe, s G [1, fc]. 



Define 



Bi = {-s I /i s - s + 1 = i}, Cj = {-s I A s 



J}- 



Then the subgroups S^) and S^.) of Sfc are exactly the images of 
and W\ under the automorphism r : Sk — ^ Sk defined by r(w)(i) = 



—w(—i). The map ip : Sk 



M, 



(bi),n;(cj) 



n as defined in §4 satisfies 



(5.1) ip(r(w)) i7j = |{s G Z I /is - s + 1 = i, X w ( s ) - w(s) = j}\. 
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So Sk[X, fj] = {w e S k \ ip{j{w))ij = 0, Vj < i — 1}, which shows that 
it is indeed a lower ideal of Sk- Moreover, w i— »■ i/;(t(w)) gives an 
isomorphism of posets between Sk[X, fj]° and 

{m G M( 6i)jn .( Cj .) jn | m > and my = 0, Vj < z - 1}, 

and the polynomials attached to these posets correspond, since 

(5-2) Pw,w' = Pt(w),t(w') = P4){t{w)),'4){t{w 1 )) 

for all w,w' G Sk[\,fi}°- Now make the assumption of Theorem 11.21 
that A//i G M^i), n ] it follows immediately that {pi) and (cj) satisfy 
the conditions of Theorem 15 .HI By (|5.1j) . for all w G Sfc[A,/i]°, the 
multisegment X/(w- /i) when viewed as a matrix has the same diagonal 
and above-diagonal entries as ipijiw)); hence A/(w • /i) = tpijiw)) + a 
where a is as in Theorem 15 .31 Thus Theorem 11.21 follows from Theorem 
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